Reexamination of experimental tests of the fluctuation theorem 



m 

O 

o 

(N 

o 
O 



I 

o 
o 



(N 
> 
00 

o 
m 
o 

-I— • 



o 



X 



Onuttom Narayan^ and Abhishek Dhar^'^ 
^Department of Physics, University of California, 
Santa Cruz, CA 95064 
^ Raman Research Institute, Bangalore 560080. 
(Dated: February 2, 2008) 

The Fluctuation Theorem and the Jarzynski equaUty are examined in the Ught of recent experi- 
mental tests. For a particle dragged through a solvent, it is shown that Q, the heat exchanged with 
the reservoir, does not obey the Jarzynski equality due to slowly decaying tails in its distribution. 
For molecular stretching experiments, substantial corrections to the Jarzynski equality can result 
from not measuring the force at the end of the molecule that is moved. We also present a proof 
of the Fluctuation Theorem for Langevin dynamics that is considerably simpler than the standard 
proof. 
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I. INTRODUCTION 

Understanding how entropy behaves is the fundamen- 
tal issue in statistical mechanics. Equilibrium statistical 
mechanics provides a powerful framework to examine a 
broad variety of systems, but is by its nature restricted to 
systems in equilibrium. Recently, a remarkable Fluctua- 
tion Theorem was proved J,] for entropy growth or decay 
for systems in a non-equilibrium steady state where the 
microscopic dynamics are time reversal invariant. This 
theorem states that in a time interval r, the probability 
p{S) of an entropy S being generated satisfies the condi- 
tion 
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where is Boltzmann's constant. The theorem was mo- 
tivated by numerical results on a shear stress model 01 ■ 
In Eq.JQ) entropy is defined in dynamical systems terms, 
through phase space contraction and expansion, rather 
than thermodynamically. 

When instead of being in a non-equilibrium steady 
state, the system starts in thermal equilibrium and then 
subject to a time-independent perturbation, a stronger 
result can be proved Q: 
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valid irrespective of the length of the observation time 
interval r. Eqs.lQ) and Q are referred to as the Steady 
State Fluctuation Theorem (SSFT) and the Transient 
Fluctuation Theorem (TFT) respectively. A simple ex- 
ample illustrating the need for the t oo limit in the 
first but not the second is given in Ref . . The fluctua- 
tion theorem was first proved for thermostatted Hamilto- 
nian systems, and later for systems undergoing Langevin 
dynamics 5] . Apart from numerical realizations 0, 0| , 
experimental tests of the fluctuation theorem have also 
been performed 

A related result was proved by Jarzynski 0, relating 
the change in free energy of a system that starts in equi- 



librium at a temperature T, when it is perturbed exter- 
nally by making its Hamiltonian time dependent. If the 
Hamiltonian starts and stops changing at time t = and 
t — T respectively, and Wj is the generalized work de- 
fined as dtdtH{t), then the Jarzynski equality states 
that 



{eM-PWj]) ^ exp[-/3AF] 



(3) 



where /? — l/ksT. The change in the free energy of 
the system between equilibrium at temperature T with 
Hamiltonian H(0) and equilibrium at the same temper- 
ature with Hamiltonian H{t) is denoted by AF. The 
Jarzynski equality relates the change in free energy, an 
equilibrium concept, to an average of nonequilibrium 
measurements. It has been used in experiments where 
a molecule is stretched at a finite rate (i.e. not adiabat- 
ically) to obtain the free energy change due to stretch- 
ing [13. The connection between the Jarzynski equality 
and the TFT was shown by Crooks '^^ho showed that 
if an externally driven system starting in thermal equilib- 
rium is compared to the same system with the external 
driving time-reversed, and there is a quantity to that sat- 
isfies 



p_(-w) 



= cxp[ijj] 
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where the ± subscript refer to the original and the time- 
reversed process respectively, then 



(exphcj])+.- = 1. 



(5) 



He then showed that S/ks is expected to satisfy Eq.l^J 
for Lo, and related uj to Wj on thermodynamic grounds 
yielding Eq.Q. When the original and time-reversed 
driving are equivalent, as with a steady state perturba- 
tion, the subscripts in Eq.Q) can be dropped, and Eq.Q 
results. 

Despite the dramatic progress in the field, some uncer- 
tain points remain. The relationship between the actual 
physical work done on a system and the generalized work 
Wj can be tricky Since Crooks' connection ^ 
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between the TFT and the Jarzynski equahty uses ther- 
modynamic arguments, it deals with the physical work 
W rather than Wj. Questions have also been raised 
about possible alternative definitions of entropy gener- 
ated |jl4, J^J , and whether the equations above would be 
satisfied. There are also issues about the experiments, 
and whether they measure what they should. In these 
paper, we seek to clarify some of these points. 

The organization of the rest of this paper and its main 
results are as follows. Section II discusses the connection 
between Wj and the physical work W in various different 
cases, showing that Eq.© (with the free energy appro- 
priately defined) is always obtained. Section III considers 
an alternative definition of entropy fluctuations in 
an experimental context 3] , and shows that Eq. Q is not 
obeyed; the violation of Eq. © grows worse as the mea- 
suring time interval r is increased. Section IV considers 
the molecular stretching experiments 10] and whether 
they satisfy the conditions required to invoke the Jarzyn- 
ski equality, demonstrating that in general there are sub- 
stantial corrections. Finally, Section V presents a very 
simple proof of the fluctuation theorem for Langevin dy- 
namics 0, generalizes it when the dynamical equations 
are linear, and discusses extensions of Eq.Q. 



II. PHYSICAL WORK AND GENERALIZED 
WORK 

Eq.© is stated in terms of the generalized work Wj, 
and was derived for a system at constant volume, 
in which case AF is the change in Helmholtz free en- 
ergy, A^. On the other hand. Crooks obtained the 
same result on thermodynamic grounds, which there- 
fore involves the actual work W done by the external 
agent that changes the Hamiltonian. As pointed out 
previously j3 the two are not always equal. For 
example, if a time dependent force f{t) is applied to 
a polymer chain, it is equivalent to a time dependent 
term in the Hamiltonian — /(t)a;. The work done along a 
trajectory J dtf{t)x{t) differs from Wj — — J xdf{t) by 
f{T)x{T) — /(O)x(O). However, Wj is not always differ- 
ent from the physical work. If the same polymer chain is 
stretched by holding its end at a fixed location and mov- 
ing this location, dfH — id^H, and the force exerted 
on the end by the polymer is equal to —dxH, so that 
the work done by the external agent in moving the end 
is equal to Wj [Tg. We distinguish, therefore, between 
experiments where the variation of the Hamiltonian can 
be expressed as the change of a coordinate, and those 
where it can be expressed as the change of a force. In 
the first case, there is no difference between the actual 
work and Wj 0|. Since in the latter case there is an 
apparent discrepancy between the result of Crooks and 
that of Jarzynski, it is worth clarifying the situation. For 
completeness, we also allow for the possibility where the 
unperturbed system is held at fixed pressure (or similar 
intensive parameter) rather than fixed volume. 



As a simple example, to make the differences between 
these cases clear, we consider a gas in a container in 
thermal contact with a reservoir at a temperature T. 
The partition between the container and the reservoir 
is either at a fixed location, or free to move to main- 
tain equal pressures in the container and the reservoir. 
Another wall of the container has a movable piston, 
which either has a definite time-varying position or has 
a definite force applied to it. When the reservoir has 
fixed volume, and the piston's position is varied in a 
definite manner, the Jarzynski equality is equivalent to 
(exp[— = exp[— 5Aj4], and there is no difference 
between W and Wj [ig. We proceed to analyze the 
remaining two cases. 

When the reservoir has a fixed pressure, and the pis- 
ton's position is varied in a definite manner, microscopic 
reversibility |l9l | in the dynamics ensures that the proba- 
bility to follow a path x{t) when the piston is moved along 
a trajectory as compared to the probability to move along 
the time reversed path if the piston is moved along the 
opposite trajectory is given by 

^g±§M=expMQ{.(+t),A(+t)}] (6) 
V[x{-t)\X{-t)\ 

where Q{x{+t), A(+t)} is the heat transferred to the sys- 
tem from the bath along the forward trajectory, and \{t) 
denotes the variation of the external (coordinate) param- 
eter. The notation is the same as in Ref. but our 
result differs in the absence of a pAV term in the ex- 
ponential on the right hand side. Eq.© is justified by 
noting that if a microstate A of the system and the reser- 
voir together evolves with time into a microstate B, then 
the time reversed microstate B' must evolve into the time 
reversed microstate A' when the variation of the exter- 
nal parameter is reversed. The right hand side of Eq.@ 
is then simply the ratio of the probability of finding the 
reservoir in the appropriate microstate that would move 
the system along the forward trajectory as compared to 
the backward one. Using a constant pressure ensemble 
for the reservoir, this ratio of probabilities is equal to 
exp[/3(J7j^ - U^+pV^ - pV^^)], where U^^j and V^^f are 
the energy and volume of the reservoir in the initial and 
final state. (One can verify that, in the absence of any 
external work, such a ratio of probabilities weights states 
of the system in accordance with the constant pressure 
ensemble.) Since AU^ + pAV^ = -Q, Eq.© follows. 

Proceeding as in Crooks 11] with the necessary 
changes, if the variable oj is defined as 

uj = \np{xi) -\np{xf) - I3Q (7) 

where pij are the probabilities of the initial and final 
states of the system, then Eq.lO is satisfied 20]. Using 
the fact that Inpij' = —P{Uij + pVij) + l3Gij, where 
G is the Gibbs free energy of the system, we obtain that 
uj = P{AU+pAV -Q- AG) = P{W - AG), and so 

{exp[-(3W]) = exp[-/3AG]. (8) 
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Thus the actual physical work is related to the change 
in the Gibbs free energy. If the process is carried out 
adiabatically, W is always equal to AG. 

On the other hand, when the reservoir has a fixed 
volume but the force on the piston is varied in a defi- 
nite manner, Eqs.®, ((Tj) and |5j still hold. However, 
Inpij — —P(Uij + FijXij) + PGij, where F and x 
are the force exerted by the piston and its coordinate. 
G = fcBTln^exp[— /3(C/ + Fx)]; if Fx is absorbed into 
?7 as in [^, this would be considered as the Helmholtz 
free energy. Now since AU = Q — W, where W = J Fdx, 
Eq.© yields 

(exp[^ J xdF]) = {exp[-f3Wj]) = exp[-/3AG] (9) 

in agreement with Jarzynski's result 01 • 

It is also possible to consider the case when the reser- 
voir is separated from the system by a movable barrier 
(that equalizes pressures on both sides) and the exter- 
nal force is applied to the same barrier. As expected, 
in this case the appropriate free energy is obtained from 
U + pV + Fx, while Wj = — / xdF. {V and x are not 
independent variables.) 

To summarize, if a coordinate of a system is varied in 
a specific way, the work done is related to the change in 
the appropriate free energy, but if a force on a system 
is varied, the Legendre transform of the work is related 
to the change in the appropriate free energy. Although 
the thermodynamic approach starts with the work in all 
cases, the final result involves the generalized work, in 

ITT, 

complete agreement with |9||. 

To make matters clearer, we consider the experimen- 
tally relevant case to which we shall return later in 
Section IV, in which a molecule is stretched by placing 
its end in a parabolic optical trap whose position is var- 
ied. If xo{t) is the center of the trap and x is the end of 
the molecule, the energy in the trap is k[x — a;o(t)]^/2. If 
H(x) is the internal energy of the molecule, the Jarzynski 
equality relates the change in free energy with H(t) = 
H{x) + k[x - a;o(T)] 2/2 to Wj = - ^ k[x - XQ{t)]dxo. If 
one considers the trap and the molecule as a single com- 
bined system, Wj is the work done by the external agent 
moving the trap, and H{t) is the appropriate Hamilto- 
nian for the combined system. On the other hand, if one 
is only interested in the molecule, then it would be de- 
sirable to find a way to exclude the k[x — xq{t)Y' /2 term 
when computing the change in free energy. This latter 
option might seem more natural, and is explored in [T^ 
and J^2J- However one could consider an alternative ex- 
periment without an optical trap, with x and xq the po- 
sitions of the second-last and last sites on the molecule, 
and dragged along a definite path. The calculations 
would then be identical, but the k[x — x^Y /2 term — or 
an anharmonic generalization thereof — would be part 
of the stretching energy of the molecule, and Wj would 
be the work done. No manipulations of the Jarzynski 
equality would then be sought. 



III. ALTERNATIVE DEFINITION OF 
ENTROPY FLUCTUATIONS 

Wang et al have performed experiments where a col- 
loidal particle in an optical trap is dragged in a solvent. 
The trap is initially at rest, and then from time i = to 
T is dragged at a uniform velocity . The instantaneous 
force exerted by the optical trap is i^opt = —k{x — xq), 
where x is the position of the particle and xq is the po- 
sition of the center of the trap. The work done by the 
optical trap on the particle is then equal to 



W{T) — -k I dtvo{x — xq). 



An integrated form of the fluctuation theorem 



Ft{W < 0) 



(exp[-/3H^] 



w>o 



(10) 



(11) 



Pt{W > 0) 
is verified . 

As discussed by Mazonka and Jarzynski 0, , the 
entropy generated can be defined as AS* = W/T or as 
AS* — —Q/T, where Q is the heat absorbed by the parti- 
cle from the solvent, which acts as a heat reservoir. The 
first definition, used by Kurchan and Crooks is 
equivalent to choosing the entropy of the particle in 
a certain state to be — Inp, where p is the probability of 
the state, and is justified by recalling that the entropy of 
the particle over the entire canonical ensemble is (— Inp). 
The second definition adopts the convention that the en- 
tropy of the particle for a specified position and velocity 
is zero, since it has no extra internal degrees of freedom, 
so that entropy is only generated by heat being trans- 
ferred to the solvent. Both definitions are reasonable; to 
some extent, the entropy of a single particle in a specific 
configuration is arbitrary. 

With AS" = W/T, it is possible to verify [H [l|| with 
Langcvin dynamics for the particle that the TFT is sat- 
isfied, in accordance with the experimental result 7]. A 
corollary of this result is that the Jarzynski equality is 
satisfied, which in this context is (exp[— /3iy]) = 1. It is 
also shown 111, fisjl that the SSFT is vahd. The question 
was raised |lj| whether the fluctuation theorem — either 
transient or steady state — is satisfied with the alterna- 
tive choice of AS' = —Q/T. In Ref. 15j, it was shown 
that even in the large time limit, if Q/t is held constant, 
the fluctuation theorem has to be modified for Q |^ . In 
this section we show that, (exp[/3(5]), analogous to the 
expression for W in the Jarzynski equality, diverges as 
T — > oo, and also for any finite r in the commonly used 
limit when the mass of the particle m — > 0. 

Because the limit of zero particle mass is singular for 
(exp[/3(3])j we start with the Langevin equation for the 
particle 



mx ~ — A.T — k{x — xq) + rj{t) 



(12) 



where m is the mass of the particle, A is a viscous damp- 
ing coefficient, and rj{t) is the thermal noise satisfying 
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{v{ti)v{t2)) = 2XkBTS{ti - t2). The center of the optical 
trap is specified by a;o — Vot9{t). The solution to Ea. l(T^ 
can be written as 

x(t) ^x{t) +S;{t), (13) 

where 

mx = —Xx — k{x — xq) (14) 

and 

mx = —Xx — kx + rj. (15) 
From Ea. (|10|l . the heat generation rate equal to 

—dQ/dt = —kvo{x—xo) — — -j^[k{x—xo)'^+mx'^] — {\x~~r])x 

* (16) 
where Ea. (|12|l is used to obtain the second form. Using 
Eg. lfT^ and Ea. lfT^ yields the result 

2 • Id 

-dQ/dt ^Xx +x[2Xi-r]]- - — [ki'^ + mx'^]. (17) 

Sufficiently long after the optical trap starts to move, 
X — » Vq. Therefore, if Ea. (|17|l is integrated over a suffi- 
ciently long time interval [0, r],, it is clear that the three 
contributions to —Q{t) are i) a deterministic term that 
approaches XvqT ii) a stochastic term that is ~ 0{y/T), 
and iii) a random ~ 0(1) contribution from the total 
derivative. Despite the relative smallness of the third 
term, it is crucial in proving that the fluctuation theorem 
is not satisfied by Q when t ^ oo with Q/t fixed n^l2l| . 
because it affects the tails of the distribution where the 
fluctuation theorem is tested. 

Even without detailed calculations, it is possible to 
understand the singularity of (exp[/3(5]) qualitatively. 
Both singularities come from the third term to the 
right hand side of Eo. ljlTI) . If m — > 0, i is un- 
correlated from one instant to the next. Therefore 
m[x^{0) — i^(r)]/2 decouples from the other contribu- 
tions to —Q{t). Since x{t) is drawn from the Gaussian 
distribution, ~ exp[— /3ma;^(T)/2], we see that the inte- 
gral over x{t) in (exp[/3Q]) diverges. Even when the zero 
mass limit is not taken, the same argument applies to 
mi^(T)/2 and to kx?(T)/2 in the t ^ oa limit. The full 
calculation is shown in the appendix. 

IV. STRETCHING EXPERIMENTS ON 
POLYMERS 

In experiments by Liphardt et al l^l, the Jarzynski 
equality is put to use in non-equilibrium stretching mea- 
surements on single RNA molecules, to obtain the free en- 
ergy change as a result of stretching. The RNA molecule 
has polystyrene beads attached to the two ends. One 
bead (bead A) is placed in an optical trap, whose center 
is kept fixed throughout the experiment. The bead at the 



other end (bead B) is held at a definite time-dependent 
position using a piezoelectric actuator. The force ex- 
erted on the molecule by the optical trap is measured. 
If the origin of the coordinate system is taken to be at 
the center of the optical trap, this force is related to the 
position of bead A by _F = — fcx. Therefore, by measur- 
ing the force, the (fluctuating) position of bead A can be 
found. If xo(i) -I- L is the position of bead B, where L is 
the unstretched length of the molecule, the stretching is 
equal to z = xq — a:. The integral 

w = — J Fdz = ^ y xd{xo — x) (18) 

is evaluated over a large number of trials, and the Jarzyn- 
ski identity is used to obtain the change in the free energy 
of the molecule as a result of stretching. 

Clearly, if the experiment is performed adiabatically, 
w will always be equal to the reversible work required to 
stretch the molecule, i.e. the change in the free energy. 
However, in the irreversible case, there are two differ- 
ences between w and the actual work done that raise a 
question about the applicability of the Jarzynski identity. 
The first is that the force exerted on bead A, not bead 
B, is measured. The second is that the stretching is mea- 
sured rather than the displacement of bead B. These may 
seem innocuous changes; indeed, the second might even 
be considered desirable, since it attempts to eliminate 
the change in the potential energy of bead A, which is 
not of interest. In order to see whether these changes are 
indeed harmless, we consider a toy model for the system 
that is admittedly unrealistic: where the RNA molecule 
is also treated as a harmonic spring. In view of the un- 
folding transition seen in the molecule, this is obviously 
wrong. Our objective, however, is to investigate whether 
the difference between w and the actual work done is po- 
tentially significant. In the same spirit, the damping and 
thermal noise forces experienced along the RNA molecule 
are neglected, and the mass of the beads is taken to be 
zero. 

In this toy model, the equation for bead A is 

Xx — —kx + K(vQt — x) + rj (19) 

where, as before, k is the force constant of the opti- 
cal trap, A is the viscous damping coefficient, and rj is 
the thermal noise, k is the force constant for the (har- 
monic version of) the RNA molecule. Bead B is assumed 
to be moved at constant speed vq over a time inter- 
val [0, r]. Proceeding as in the previous section, defining 
to — X/{k + k), Ea. ((T^ has the solution 

x{t)^^-^(l-eM-t/to])+i (20) 
K + k K + k \ / 

where 

x(t) =5(0)cxp[-t/<o]+ / dti'^eiip[-{t-ti)/to]. 
Jo ^ 

(21) 
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Substituting this solution in Ea. (|18|l yields 

dw/dt = ^^{t-to(l_e-*/to)} + fcj 

-{fc + Ke~*/*°}-x 



k + K 
k + K 



(22) 



where A™ is the internal free energy of stretching of the 
molecule, and x(0),x(t) are the starting and ending po- 
sitions of bead A relative to the initial center of the trap. 
(Bead B is fixed throughout.) On the other hand, the 
quantity of interest is A'". An elegant method to obtain 
A™ is due to Hummer and Szabo which relies on a 
stronger version of the Jarzynski equality: 



If ?;o ^ while keeping vqt fixed, i.e. the adiabatic limit 
is taken, the only term in w{t) that survives comes from 
integrating the product of the first term in each bracket. 
This is the change in free energy of the harmonic RNA 
molecule. Accordingly, the dissipative work satisfies 



dw o/dt = 



[k + 
kv{)X 



to(fc + Ke-*/*'')(l 



-t/to\ 



[k- 



-t/tol 



^^[t-to(l-e-*/*«) 



kdx jdt. 



(23) 



Comparing with Ea. H17|l . this has the same structure of 
a deterministic term, a Gaussian stochastic term and a 
total derivative. However, if t >> it can be seen that 
the integral of the deterministic term is negative, so that 
(exp[— /3w_d(t)]) cannot be equal to 1. 

To solve for the dynamics of the system correctly, one 
would need to modify Eq. 119() by using the full nonlinear 
force from the stretching of the molecule, and including 
the damping and thermal noise acting along the length of 
the molecule. This would be difficult, and not amenable 
to an analytical treatment. Experimentally ^10.] . good 
agreement is found between the free energy determined 
by non-equilibrium and adiabatic stretching. It is not 
clear whether this is fortuitous, or can be justified: per- 
haps the fact that the non-equilibrium nature of the ex- 
periments are only seen to be significant when the RNA 
molecule goes through its unfolding transition might 
make w as defined in Ea. H18|l better behaved. For in- 
stance, the fact that the bead in the optical trap moves 
backwards in the unfolding direction means that the re- 
sult {w£){t)) < found (for t » to) for the toy model 
will not be the case for the real system, so deviations 
from the Jarzynski equality are less dramatic. 

The reliable method would be to modify the experi- 
ment and move the optical trap while keeping the other 
end fixed. If the force and displacement of the opti- 
cal trap are measured, as in the previous section, the 
Jarzynski equality can be safely invoked p3 |. Even with 
the modified experiment, the displacement of the optical 
trap rather than the stretching of the molecule must be 
used in computing the work. As discussed briefly in Sec- 
tion II, the Jarzynski equality will then yield the change 
in the free energy of the optical trap and the molecule 
together, i.e. 



-0wj{t)\ _ 



Jdx{T)exp[-f3{A''^{x{T)) + |(x(r) - vt)^}] 



/dx(0)[-/3{Ai"(a;(0)) + fca;(0)V2}] 



-I3wj(t) 



6{x{t)—x)) = 



exp[-/?{A'"(a;) + k{x - vt)^/2}] 



J dx{0)[-(3{A^'^{x{0)) + fca;(0)2/2}] 

(25) 

where the quantity averaged on the left hand side is 
exp[—Pwj{T)]/e for experimental trials when x < Xr < 
x + e and zero otherwise, for small e. Summing both sides 
of Eq. H25|) yields (|24|l . Eq. II25[I can be proved by invoking 
the Feynman Kac theorem |23|. The k{x — vtY /2 term 
in Ea. (|25|l can easily be transferred to the left hand side. 
Numerics with different values of r, with x chosen to be 
close to its optimal value for each r, were used to 
obtain the free energy profile. Note that it is not cor- 
rect to choose a different r for each experimental trial so 
that x{t) is always equal to x and seek to apply Ea. (P5|l . 
i.e. to perform an experiment of variable duration with 
a definite extension of the molecule at the end of each 
trial. Such a protocol would yield 

(e-/5-./(-)) oc / dTexp[-/3{A'"(x)-f-(x-vT)2}] 

Jo 2 

cx [1 + eTf{xy/pk/2)] exp[-/3^'"(a;)] (26) 

if tm — ^ oo. 



V. FLUCTUATION THEOREMS FOR SYSTEMS 
WITH LANGEVIN DYNAMICS 

We consider a system of particles with generalized co- 
ordinates X = {xi} and velocities v = {vi = xi} and 
described by the Hamiltonian 



Hix,v)^j:^ + n-) 



(27) 



where V is an interaction potential. We assume that the 
system is in contact with a heat reservoir, and its time 
evolution is describable by Langevin dynamics. A set of 
external forces {/;} act on the particles and perform work 
on it. Thus the equations of motion are given by: 



miXi 



dV 

dxi 



+ flit) - Xixi + rji 



(28) 



(24) 



where rji is Gaussian white noise with the correlator 
{riiit)Vm{t')) = 2XikBTS{t - t')Si^. For stochastic 
systems, the fluctuation theorem — and therefore the 
Jarzynski equality — was proved by Kurchan Q. We 
provide a simpler proof, through Eq.®. For discrete 
systems, evolving, for example, through Monte Carlo dy- 
namics, Eq.® has been proved [TH . Here we give a proof 
for systems evolving through Langevin dynamics. 
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The principle of microscopic reversibility relates the 
probability of a particular path in phase space to the 
probability of the time-reversed path. Consider the evo- 
lution of the system from time t — to t — t through 
a path specified by {x{t),v{t), f{t)}. The probability of 
this path is given by: 

V+ = AAcxp[-^A£dt^2(^)] 

= A/'exp[- V -ff / dt{miii + - fi{t) + Xiiif 



As discussed after Ea. (P5|l . Ea. (|SS|l is true even without 
x{t) being averaged, so that exp[/3/(T) • x(t)] can be 
canceled on both sides and 



where A/" is a normalization constant. Now consider the 
time-reversed path given by {x'{t), v'{t), f'{t)} = {x{t — 
t), —v{t — t), /(r — t)}. The probability of this path is: 

V- = AAexp[- ^ ^ jWmix'i + |^ - //(<) + Xi±[)'] 
= AAcxp[- II ^ ^ dt{mixi + 1^ - - Xixif] 



(30) 



Taking the ratio of the two probabilities leads to the prin- 
ciple of microscopic reversibility 



V- 



exp[-/3 V / dt[ 
exph/3Q], 



dV 

mixi + fi{t)]xi] 

oxi 



(31) 



where Q is the amount of heat transferred from the 
heat bath to the system. The identification of Q as 
the heat transfer can be seen either by noting that 
Q = Ei/J^Kiz + f^-ZiWlii = Y.i!o dt[-\ixi+i^i]xi 
which is clearly the energy flow from the heat bath. Note 
that in the absence of external forces the principle of mi- 
croscopic reversibility reduces to the usual detailed bal- 
ance principle which states that: 



P{xf,Vf\xi,Vi) 
P{xi,-Vi\xf,-Vf) 



-0[H{xf,Vf)-H(x,,vO] 



(32) 



where P{x,v\x' ,v') denotes the probability of being at 
{x,v) at time t = t given that it was at {x' ^v') at time 
t — Q. This follows if we integrate Eq. (|31|l over all paths 
between {xi,Vi) and {xf,Vf). From Eas. (|31|) and (|32|l . 
the fluctuation theorem and the Jarzynski equality can 
be obtained as in Crooks discussed in Section II. In 
particular, when the external forces are switched on at 
time t — 0, 

(exp[/5 / X ■ df]) = (exp[/3/(T) • x{t) - /3 / dtf ■ v]) 



(33) 



(exp[-/3i/(x(r), v{t)) + /3/(t) • x(r)]) 
(exp[-/3i/(x(0),i;(0))]):r(o),t-(o) 



(exp[-/3 



/ dtf-v]) = l. 
Jo 



(34) 



If one compares the system starting in thermal equilib- 
rium with a force f{t) switched on for < i < t, with the 
same system but with a force f{T — t), then the variable 
Lu in Ref. [13 is 



(29) 



lnp{xi,v^) - liip{xf,Vf) - 
lnp{xi,Vi) - lnp{xf,Vf) 

~l3[H{xf,Vf) ~ H{xi,v.i) 



dtf ■ v] 



13 dtf- V. 
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(35) 



When the force that is switched on is time independent, 
then Eq.lQ reduces to the result of Ref. 0. In fact, even 
when f{t) depends on time, if the equations of motion 
Ea. (P5|) are linear, the distribution of w = /3 /J" dtf ■ v 
is Gaussian for both the original and the time reversed 
process, i.e. 



p+{uj) exp[-(w - m+)V2cr+] 



P-{—uj) exp[— (w -I- m_)2/2cr_] ' 
Comparing to Eq.l^J we see that = (t_ and rii^/a^ 



(36) 



TO_/(T_, i.e. 



m_ (since m± > 0). Further, 



m±/a± = i. One can thus drop the subscripts in Eq.l^J 
for linear equations of motion for arbitrary f{t). 

More generally, when the interaction potential depends 
on a set of externally controlled parameters p,{t) so that 
we have H — H(x, v, fi). In this case we get 



E 



[miXi 



dVix,fi) 



dx, 



xi 



mivf 



; I 
= H{xf,Vf,fif) - H{xi,Vi,fii) -Wj (37) 

Now if we take p = e-/3[H(:E,i>,^0-^'(/^)] where F(/i) = 
— (1//3) ln(J dxdve''^^^^'^'^^'^) is a generalized free energy 
then we get the Jarzynski result: 



(38) 



The principle of microscopic reversibility can be used 
to derive some other interesting results that are related 
to the Jarzynski result and have been derived using 
other approaches. We again consider the case with a 
time dependent Hamiltonian in which case Eq. (|31|l gives 
e-awj-p^ ^ g-/3[H(2;j,«^,M/)-ff(x,,t,,.p,)]p_. Integrating 

both sides over all paths between the fixed initial and 
final points then gives: 

/„-l3Wj\ixf,Vf} 

\ '(Xi.Vi) 
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where Pfi{xi, ~Vi\xf, —Vf) is the transition probabihty 
under the action of the time reversed Hamiltonian. If 
we now integrate over all initial states chosen from the 
canonical ensemble, Ea. l25|l results. 



VI. CONCLUSION 

In this paper, we have analyzed recent experimen- 
tal tests of the Fluctuation Theorem and the Jarzynski 
equality. For a particle dragged through a solvent [3| , the 
heat absorbed, which has been suggested as an alterna- 
tive definition [11 HI of the entropy generated, violates 
the Jarzynski equality. In the experiments on molecu- 
lar stretching [ij, the fact that the force is not mea- 
sured at the end of the molecule that is dragged can 
lead to substantial deviations from the Jarzynski equal- 
ity, even changing the sign of the average 'work'. We 
have also provided a proof of the fluctuation theorem for 
systems governed by Langevin dynamics that is much 
simpler than the standard proof |5|, and have general- 
ized it slightly for linear Langevin equations. Finally, we 
have also clarified the connection between the thermody- 
namic work used in a thermodynamic derivation of the 
Jarzynski equality and the generalized work in the 
original derivation verifying that Eq.© is obtained 
in all cases. 
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APPENDIX A: GAUSSIAN INTEGRAL 

In this appendix, we evaluate the singularity in 
{exp[/3Q]) discussed in Section III. Defining Gaussian 
variables 



2/1 = / dtx[2Xi{t) - -qit)] 
Jo 

2/2 = %/mi(T) 
2/3 = Vmx{0) 
2/4 = Vkx{T) 
2/5 = Vkx{0) 



(Al) 



we have 



/3Q(r) = -/3A X ~ f3yi + -P[yi-yi + yi~yi]. (A2) 

From Ea. H14() . it is straightforward to see that 

x(t) = vot — -t- Al exp[— q;i<] + A2 exp[— Q;2t] (A3) 
k 



where the two exponentially decaying terms are the so- 
lutions to the homogeneous equation for x from Ea. p2|l . 
satisfying 

aia2 = — , ai + a2 = —■ (A4) 
m m 

With the initial condition a;(0) — x{Q) — 0, 

^^^^vJl-Xa2^_ (A5) 
ai,2 ~ a2,i 

Similarly, from Ea. ljlSI) . one obtains 

^^^^ ^ aixjo) + m ^-c.t I + m ^-c.t 

ai — a2 0-2 — ai 
dt'^- . (A6) 







m 



Q!2 - ai 



Using Ea. (|A6|l . it is possible to obtain the correlation 
between the Gaussian variables 2/1 ... 2/5, as follows: 

(2/1) = 2XkBT I dt±^{t) 



(2/12/2) = (2/1^4) 

, , 2\kBT /■ , . ,^,a2e-"^*-aie-«i* 
(2/12/3) = — I dtx(t) 



(2/12/5) = / dtxit)- 



m J a2 ~ ai 

{vD - {vD - (2/4> - {vD - ksT 
(2/22/4) = (2/32/5) =0 _ 

— ksT 

m 0:2 — 0:1 

(2/22/3) = '\/^^^^32/4) 

Q;2e^"i^ - aie""^^ 
(2/42/5) ksT . 

0:2 — Oil 

In terms of the correlation matrix Af^ = {ytyj), 



(A7) 



(exp[/3(3]) cx J dyi... dys exp[-/3A J x - Pyi 

+ J/3(2/l-2/3 + 2/4'-2/l)- ^Ey^^^i^'y^] 



where the normalization is obtained performing the same 
integral with all terms in the exponential dropped except 
for the last. The integral is formally straightforward: 
defining the matrix 



7V = M~i-|-/3diag(0,-l,l,-l,l) (A9) 



one obtains 



(exp[/3Q]) = exp[-/3A J + ^/J^^nV^det N det M. 

(AlO) 

To see the singularity clearly we first take the to ^ 
limit. From Eg . (jA4p . one of 0:1.2 must diverge in this 



8 



limit; we choose this to be a^- Dropping all terms with 
exp[— a2T] in the correlation matrix M, and defining e — 



M 



(B[t) 


eC[T) 


VC(r) 




1 





eC{T) 
-e'E{r) 
1 

eE{T) 







eE{T) 
1 

Eir) 



C{t) \ 
-eE{r) ^ 


Eir) 
1 

(All) 



where 



B{t) 

C{t) 
Eir) 



2A 



dm (t) 

2XVk 



m{a2 — o-i) 

■ exp[— aiTj 



dtx{t) exp[— Q!ii] 



a2 — Oil 

Notice that B{t), C{t), E{t) are not singular as m 



(A12) 



0. 



Changing variables from 2/2,2/4 to (y2 + ej/4)/(l + e^)^/^ 
and (2/4 — e?/2)/(l + e^)^^^, the matrix M/ksT changes 
to 



fB{T) eC(T) 

1 

eC(T) ^ 

eVm^E{T) 

\C{t) 



C{r 





) \ 



eVT+l^E{T) 

1 VTT?i;(T) 



VTTe2i;(T) 1 

(A13) 

The second row and column decouple from everything 
else. From Ea. ljA9l) . the second row and column of the 
matrix N are then zero. (The diagonal matrix in Ea. l|A9|) 
is not affected by the change of variables from Ea. ljAll|) 



to Eq.(|AT3l).) Taking the m ^ limit in all other rows 
and columns of M, it is possible to see that this is the 
only singularity in this limit in Ea. ljA10|l . 

When m is very small but not zero, it is easy to see 
that the offdiagonal terms M2i = Mi2 are 0(exp[— a2T]), 
while M22 is still ksT. Therefore N2i = N i2 ar e 
0(exp[-a2T]) and N22 is 0(exp[-2a2r]). In Ea. (|A10p . 
detMdetA*" is 0(exp[— 2q;2t]), while is regular as 

TO ^ 0. Therefore 

(exp[/3Q]) - 0(exp[a2T]) - 0(exp[Ar/TO]) (A14) 

where a2 = [A + (A^ — Akm)'^/'^]/ {2m) w A/to has been 
used. 

Even when to is not small, in the t ^ 00 limit, 
exp[— q;i_2t] 0. In Eas. (|A7(l . in this limit all cross- 
correlations are zero except for (2/12/3) and (yij/s). Thus 
the second and fourth rows and columns of the ma- 
trix N are zero in this limit. More accurately, since 
exp[— q;2'''] << exp[— Qfir] one can proceed as above 
(without assuming that e is small), and obtain that 
N2r = Ni2 = 0(exp[-a2T]) and iV22 = 0(exp[-2a2r]) 
as before. In addition, in the remaining 4x4 subma- 
trix formed by eliminating the second row and column, 
Nii = iVj4 = 0(exp[— Qfir]) and N^j^ — 0(exp[— 2q;it]). 
Therefore 

(exp[/3Q]) - 0(exp[(a2 + "Ot]) - 0(exp[At/TO]). 

(A15) 

This has the same form as the previous equation, though 
the singularity in the two cases come from the to — > 
and the t — > c» limit respectively. 
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